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© High speed machine scanning of documents 
such as checks produces digital check images that 
are placed in archival storage on mass storage de- 
vices for later retrieval. Images and/or documents 
are automatically reviewed by a machine in order to 
identify images and/or documents that are of sus- 
pect quality. Machine review of suspect images 
and/or documents provides a reject or accept de- 
cision. Only acceptable documents are archived. Ac- 
cepted documents are formed into large data groups 
that contain a storage location identification for each 
individual document within the large data group. An 
index is stored for each such data group wherein the 
storage location of each document within the large 
data group is contained. Digital images are selec- 
tively converted to visual images, and these visual 
images are then reviewed by a human operator. This 
operator review is used to adjust the machine's 
accept/reject decision making process, thereby 
teaching the machine the correct manner of making 
its accept/reject decision. 
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CROSS-REFERENCE TO RELATED APPLICA- 
TION 

U.S. Patent Application Serial Number 
08/195,728, entitled "Image Quality Analysis Meth- 
od and Apparatus", filed February 14, 1994, incor- 
porated herein by reference. 

BACKGROUND OF THE INVENTION 

Field of the Invention: 

This invention pertains to the field of high 
speed processing of documents, such as checks, 
so as to produce digital images thereof, these 
images then being indexed and cumulatively stored 
on mass storage devices for later retrieval. 

Description of the Prior Art: 

Financial institutions are generally required to 
maintain archives of financial documents and re- 
lated data for several years. Typically, these ar- 
chives are maintained using the original documents 
and/or microfilm images of the documents. In the- 
ory, imaging technology offers many advantages in 
maintaining these archives. However, in practice, 
the use of this technology to create and manage 
billions of document images, such as in check 
archives, has not been practically achieved prior to 
this invention. 

The use of a computer-based image process- 
ing system or image capture platform to scan doc- 
uments, such as checks and the like, and to then 
digitally store the results on mass storage devices 
is generally known in the art. 

U.S. Patent 4,888,812, incorporated herein by 
reference, discloses such a check processing sys- 
tem that is based upon an IBM 3890 high speed 
document reader/sorter wherein features, such as 
feeding checks to an image scanner, monitoring 
image quality and possibly interrupting the process 
as a result of poor image quality, image data 
compression, image resolution control, parallel pro- 
cessing of image data, and storage of check im- 
ages on both high speed and low speed mass 
storage devices, such as magnetic storage and 
optical storage, are provided. 

U.S. Patent 4,941,125, incorporated herein by 
reference, describes an information storage and 
retrieval system wherein a digital camera scans 
documents to form video images. A data processor 
generates index information corresponding thereto. 
The video images and the corresponding index 
information are stored on different areas of optical 
media. The index information is generated by the 
use of self-index software that is responsive to text, 
and manually by the use of a keyboard. Remote 



location access is provided. 

U.S. Patent 5,170,466, incorporated herein by 
reference, discloses a storage/retrieval system 
wherein documents, such as checks, are scanned, 
s digitized, compressed and stored in archival mod- 
ules. The stored documents can then be retrieved 
and processed by workstation operators. 

U.S. Patent 5,187,750, incorporated herein by 
reference, discloses a checking account document 
ro processing, archival magnetic/optical storage, and 
printout system having image capture and image 
retrieval functions. 

Prior to the present invention, one of the major 
impediments to the creation of a high volume im- 
;s age archive system was the practical difficulty as- 
sociated with creating and managing an index of 
the billions of archived documents. Existing ar- 
chival image storage devices (typically referred to 
as filefolder systems) are designed to store and 
20 index a volume of items that is typically at least 
1 ,000 times smaller (i.e., typically on the order of 1 
million items) than the volume of items that are 
stored and indexed by operation of the present 
invention. 

26 The above-mentioned filefolder systems typi- 

cally use an indexing method that simply assigns 
an index record to each item. This index record 
associates a unique identifier (e.g., a document 
capture sequence number combined with a capture 

30 date) with a pointer to the actual physical location 
of the item on a particular archive storage media 
volume. The index records for all archived items 
are then accumulated in a large table, or file, called 
an all-items file. At retrieval time, this table is 

35 searched for the index record of the item(s) to be 
retrieved. This index record then provides the in- 
formation necessary to locate the item on an ar- 
chive storage media volume. 

Current computer technology places a practical 

40 limit on the size of such an all-items index file that 
is well below the billion item requirement of a high 
volume image archive system that is used to ar- 
chive images of documents, such as checks. 

Prior to the present invention, another major 

45 impediment to the creation of a high volume image 
archive system was the practical difficulty asso- 
ciated with managing image capture, quality assur- 
ance, indexing and archive of millions of docu- 
ments daily, on a cumulative basis, without requir- 

50 ing human intervention. For example, existing im- 
age filefolder systems typically require human In- 
tervention on a permanent basis for at least the 
indexing and quality assurance steps of the pro- 
cess. If thousands of documents are to be cap- 

55 tured. quality assured, indexed and archived each 
minute, human intervention of even a few seconds 
per document is clearly not practical. 
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SUMMARY OF THE INVENTION 

The present invention provides an apparatus, 
process and system architecture enabling more 
efficient use of imaging technology to manage the 
capture, quality assurance, indexing and archiving 
of a very large number of documents on a daily, 
accumulating basis. A hierarchical indexing means 
is provided which accommodates the indexing of 
billions of individual archived items. 

The present invention provides document im- 
age processing that includes suspect image and 
suspect document evaluation, this evaluation op- 
erating to automatically identify suspect im- 
ages/documents. A plurality of digital images are 
formed of each document. Suspiciousness values 
are computed for each digital image, and these 
suspiciousness values are weighted in accordance 
with their criticality to archiving of the document. 

As the terms are used herein, a document or 
check comprises the well-known hard copy of a 
document, such as a check. This hard copy of a 
check contains, for example, pre-printed graphic 
images and text, alphanumeric data that is printed 
using MICR ink, and machine printed and/or hand 
written data, such as the check's payee and 
amount. 

The terms document image data or image 
data, as used herein, generally mean one or more 
digital pictures of the document or check. 

The term coded data, as used herein, generally 
means data captured via Optical Character Reading 
(OCR), MICR reading, and the machine reading of 
handwritten data from the document or check. 

The terms associated data or arbitrary asso- 
ciated data, as used herein, generally means user- 
defined data that is associated with the document 
or check, examples of which may be voice annota- 
tion data that is provided by a human operator at 
the time of document scanning, and signatures 
from a signature card that is associated with a 
particular checking account. 

The term Document Data Structure (DDS) is 
intended to mean a collection of the above-defined 
image data, coded data, and associated data that 
relates to a given document or check. 

As used herein, the term suspiciousness or 
suspiciousness value is intended to mean a mea- 
surement that is made by machine computation, 
this measurement being a simulation of the judge- 
ment that a human would make while viewing an 
image, and determining the ability of the image to 
convey meaningful information to a human viewer. 
In other words, the machine's measurement of the 
probability that a human would judge an image to 
be acceptable or unacceptable. 

The invention provides for the archival storage 
of DDSs (i.e., digital images, related coded data, 



and associated data). Camera images are first 
formed by scanning the check. A plurality of digital 
images are then derived from each camera image. 
For example, the following four digital images are 

5 formed from the front and back camera images of 
a check: Front view, black/white image (FBW); front 
view, gray scale image (FGS); back view, 
black/white image (BBW); and back view, gray 
scale image (BGS). 

70 An optional feature of the invention provides 

human review of images/documents, usually suspi- 
cious images/documents. Data and reports are 
generated to summarize image quality analysis re- 
sults for individual suspect images of a document, 

is for an entire document, and for Units of Work 
(UofW) comprising a very large number of docu- 
ments (for example, in the range of 100,000 docu- 
ments). 

A plurality of digital image quality analysis pa- 
20 rameters are operator defined. Using these param- 
eters and any anomalous conditions detected dur- 
ing scanning and/or subsequent image processing, 
a suspiciousness value is computed for each digital 
image, document and UofW, Images and/or docu- 
25 ments having suspiciousness values above oper- 
ator-defined thresholds are identified as suspect 
documents. A document may also be identified as 
a suspect document independent of the directly 
detected quality of its digital images (for example, 
30 as a result of a detected malfunction in the docu- 
ment scanning mechanism during scanning of the 
document). 

Image, document and UofW accept/reject de- 
cisions may be made based upon the computed 

35 suspiciousness values of each, and upon the image 
quality accept/reject parameters for images, docu- 
ments, and UofWs. Rejected images, documents, 
and/or UofWs may be recaptured. Archival storing 
typically occurs only for images, documents and/or 

40 UofWs for which an accept decision has been 
made. 

Optional human visual review is provided of 
documents images that are suspect, or are asso- 
ciated with documents that have one or more digi- 

45 tal images that are suspect. An accept/reject de- 
cision may be made based upon this visual review. 
This decision may override the machine ac- 
cept/reject decision for images, documents and 
UofWs. In addition, this human review of accepted 

so documents is supported as a check on the ma- 
chine accept decision. This optional human review 
of the machine operation facilitates adjustment of 
the image quality parameters so that the machine 
accept/reject decision more nearly corresponds to 

55 the accept/reject decision that a human would 
make. Some of the operator-defined parameters 
allow the optional human visual review step to be 
bypassed when the system is operating within nor- 
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mal or acceptable limits. 

The present invention also provides a construc- 
tion and arrangement that operates to automatically 
consolidate, or block, a plurality of ODSs into a 
large data block of, for example, 100 checks (this s 
data block herein being called a ODS group as in 
FIG. 5) for efficient archival storage on a variety of 
media, including magnetic disks, magnetic tapes, 
and optical disks. 

For example, the DDSs corresponding to 100 io 
sequentially captured checks can be assembled 
into a DOS group for archival storage. 

The present invention provides a hierarchical 
indexing method which, when combined with the 
above-mentioned method of DOS data consolida- 75 
tion, provides a practical means for indexing bil- 
lions of individual checks, and that also allows 
appropriate trade offs to be made between retrieval 
performance and cost. 

The storing of each DDS group also results in 20 
the storage of an DDS group level index that con- 
tains the address of each individual DDS that is 
contained in the DDS group. A typical retrieve 
request identifies a specific DDS. The identifier 
number of this DDS leads to the DDS group in 25 
which the DDS is located, and the DDS group level 
index of that DDS group provides the address of 
the requested DDS and, eventually, the individual 
digital image, coded data and associated data por- 
tions of the DDS. 30 

As a feature of the invention, temporary stor- 
age of DDSs is provided. This temporary storage 
may be automatically erased and prepared for 
reuse after archival storage. 

These and other object, advantages and fea- 35 
tures of the invention will be apparent to those of 
skill in the art upon reference to the following 
detailed description, which description makes refer- 
ence to the drawing. 

40 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 shows the general configuration of an 
image archive and retrieval system 
that includes an archive subsystem in 45 
accordance with the invention. 

FIG. 2 shows the system topology of the im- 
age archive and retrieval system of 
FIG. 1 that includes an archive sub- 
system in accordance with the inven- so 
tion. 

FIG. 3 shows the major structural compo- 
nents that comprise the archive sub- 
system of the invention. 

FIG. 4 shows the capture/archive work flow es 
of an embodiment of FIG. 3. 

FIG. 5 is a diagram showing the sequential 
method of storing DDS group files, 



and the manner in which each file 
contains a hierarchical index in accor- 
dance with the invention. 

FIG. 6 illustrates how the image quality ana- 
lysis facility of FIG. 3 selectively op- 
erates in an automatic mode, or a 
human intervention mode at the elec- 
tion of an operator. 

FIG. 7 illustrates the work flow operation of 
the invention. 



DESCRIPTION OF THE PREFERRED EMBODI- 
MENT " 



The present invention relates to an archive 
subsystem that forms a portion of a larger image 
archive and retrieval system. FIG. 1 discloses the 
general configuration of such an archive/retrieval 
system 10. The present invention generally deals 
with archive subsystem 1 1 . 

FIG. 2 provides a topology showing of ar- 
chive/retrieval system 10. FIG. 2 includes a com- 
munication network 15 whose architecture is not 
critical to the invention. Network 15 communicates 
with a token ring network 16 that is located to serve 
a remote site A, with a remote site 18, and with a 
capture site 19 having a local token ring network 
20. FIG. 2 is intended to be a nonlimiting repre- 
sentation and may, in fact, comprise multiple con- 
figurations of this general type, such configurations 
having, for example, multiple capture sites, multiple 
local and remote site servers, and multiple local 
and remote client workstations. 

Archive subsystem 11 of FIG. 1 is located at 
capture site 19 of FIG. 2. Archive subsystem 11 is 
responsible for the capture, evaluation, and long- 
term storage of DDS, these functions being per- 
formed in a manner to optimize cost, processing 
efficiency, and image quality. Thus, archive sub- 
system 1 1 operates to capture, quality assure, and 
store DDS so that the DDS can be easily, cheaply, 
and reliably found later. 

In general terms, archive subsystem 1 1 is con- 
structed and arranged to automatically block many 
individual DDSs into a consolidated DDS group for 
efficient storage on a variety of media, including 
magnetic disks, magnetic tapes and optical disks. 
Archival subsystem 11 includes a suspect im- 
age/document processing function that automati- 
cally evaluates suspect images/documents, ranks 
the suspect images/documents by their degree of 
suspiciousness, allows high speed human review of 
suspect images/documents, and accumulates data 
and reports image quality statistics for the individ- 
ual suspect images of a document, for entire docu- 
ments, and for UofW comprising a number of doc- 
uments. 
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With reference to FIG. 3, archive subsystem 1 1 
comprises three major structural components that 
operate to implement the three processes of (1) 
image capture, (2) suspect image processing, and 
(3) image archiving; i.e., capture system 24, sus- 
pect image system 25. and archive system 26 that 
includes archive storage devices 27. 

Capture system 24 provides the image capture 
function for archive subsystem 1 1 . Capture system 
24 is implemented by (1) high speed capture pro* 
cess 29, one embodiment of which is the IBM 
ImagePlus High Performance Transaction Applica- 
tion Library Services (HPTS ALS) with an IBM 
Check Processing Control System (CPCS), by (2) 
image database 36, one embodiment of which is 
the IBM ImagePlus High Performance Transaction 
(HPTS) with an IBM Check Image Management 
System (CIMS), and by (3) anomalous condition 
detection process 130, one embodiment of which is 
an IBM 3897 that operates to generate anomalous 
condition flags. 

Capture system 24 operates to produce one or 
more digital images of a document, such as a 
check, each of these digital images being derived 
from a camera image of the check. For example, 
the front and back camera images of a check are 
operated upon by a computer to produce the four 
digital images FBW, FGS, BBW, and BGS. 

The CPCS portion of high speed capture pro- 
cess 29 provides for the management of coded 
data, such as the checks MICR characters identify- 
ing the check's account number, the bank's ABA 
number and the check's sequence number. CPCS 
also provides control of, and reporting of the results 
of high speed handling of checks and the like 
using, for example, the IBM 38907XP family of 
document processors (see above-mentioned U.S. 
Patent 4,888,812). 

The HPTS portions of high speed capture pro- 
cess 29 and image database 36 manage the image 
data. The functions of image processing, image 
archiving and image retrieval are built on a soft- 
ware enabling base that is provided by HPTS ALS. 

Suspect image system 25 is implemented by 
(1) Image Quality Analysis (IQA) process 30, (2) 
Suspect Image Review (SIR) process 31, and (3) 
Image Quality Reporting (IQR) process 32. 

Image quality analysis process or facility 30 is 
a batch process system that provides automatic 
identification and analysis of suspect document im- 
ages. 

Suspect image review process, or facility 31, 
selectively provides operator review of suspect im- 
ages at operator workstations. 

Image quality reporting facility 32 is a batch 
process system that accumulates data from image 
quality analysis facility 30, and generates reports 
that are based upon this data. 



Archive system 26 is implemented by (1) hier- 
archical index/data consolidation process 33, one 
embodiment of which is the IBM Image Archive 
Consolidation Facility (IACF), (2) hierarchical stor- 
s age access process 34, one embodiment of which 
is the IBM Object Access Manager (OAM), and (3) 
archive storage devices 27. 

In one embodiment, hierarchical index/data 
consolidation process 33 provides an interface tai* 
io lored for the captured images that are provide by 
the HPTS ALS portion of high speed capture pro- 
cess 29. The primary function of hierarchical in- 
dex/data consolidation process 33 is to consolidate 
captured images that are provided by high speed 
75 capture process 29 into DOS groups so as to 
provide optimum storage in storage devices 27 of a 
very large number of document images, and to 
provide optimum retrieval and unbundling, or de- 
consolidation, when later retrieving any number of 
20 document images from storage devices 27. 

Hierarchical index/data consolidation facility 33 
operates to copy digital images from the CIMS 
portion of image database 36, and to consolidate 
these images into large DDS data structures (i.e., 
25 large data structures for storing document images 
and information in digital form, sometimes called 
BLOBS) that are then moved to, or stored in, 
storage devices 27 under control of hierarchical 
storage access facility 34. 
30 Hierarchical storage access facility 34 provides 

for the storage and retrieval of DDS data that is to 
be stored in, or read from, storage devices 27. 
Hierarchical storage access facility 34 provides a 
constant interface between hierarchical index/data 
35 consolidation facility 33 and storage devices 27, 
independent of what specific type of storage de- 
vices are used in storage 27 (for example, mag- 
netic or optical storage). 

FIG. 4 shows an embodiment of the cap- 
40 ture/archive work flow that is provided by FIG. 3. 
Image scanner 37 operates to scan checks and the 
like, as is described in above-mentioned U.S. Pat- 
ent 4,888,812, The scanner output therefrom is 
provided to image capture system 24. 
45 Capture system 24 identifies document images 

and/or document and/or UofW whose quality is 
suspect. Image quality reporting facility 32 provides 
detailed reports relative to the input to image qual- 
ity analysis facility 30, and the output from image 
50 quality analysis facility 30. 

Capture system 24 automatically reviews each 
digital image of each document, looking for a vari- 
ety of machine detectable anomalous conditions, 
while simultaneously verifying the correct operation 
55 of associated scanning devices and software. Any 
detected anomalous condition in either the docu- 
ment image or its associated data, or in the opera- 
tion of the image capture system, causes the re- 
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lated image and/or document to be flagged as a 
suspect image and/or document. It is to be noted 
that a document can be flagged as a suspect 
document in the absence of any suspect image 
being found relative to the document. For example, 
if during the scanning of a document it is noted 
that the document moved too slowly, or if it is 
noted that the document illumination lamp was too 
bright during scanning, then the document will be 
flagged as a suspect document. A list of all sus- 
pect documents, and the identifying suspect flags 
that are associated therewith, is created by capture 
system 24 in a data file. All captured image data is 
stored on DASD 39 independent of whether or not 
the image data is suspect image data. 

Image quality analysis facility 30 operates to 
perform a statistical analysis of suspect im- 
age/document/UofW data. For example, but without 
limitation thereto, image quality analysis facility 30 
determines the quality of each image that is iden- 
tified as a suspect image by image capture system 
24, or of each image that is associated with a 
suspect document, determines the quality of each 
document that is identified as a suspect document, 
or has one or more suspect images, and deter- 
mines the quality of each UofW that includes one 
or more suspect images or documents. The results 
of this determination are accumulated in a file for 
use in the review of suspect images/documents, 
and for use in image quality reporting by image 
quality reporting facility 32. If a UofW has no sus- 
pect images and/or documents, this fact is simply 
recorded relative to this particular UofW. 

Image quality analysis facility 30 is selectively 
operable in either an automatic mode or a ver- 
ify/human intervention mode. In the automatic 
mode, image quality analysis facility 30 commu- 
nicates directly with hierarchical index/data consoli- 
dation facility 33, as shown at 40 in FIG. 4. In the 
verify mode, image quality analysis facility 30 com- 
municates with hierarchical index/data consolidation 
facility 33 and suspect image review facility 31 
under manual control, as shown at 40 and 41. 

The verify mode of operation can, for example, 
be used to allow the operator to review accepted 
UofWs at suspect image review facility 31 in order 
to verify that the parameters by which image qual- 
ity analysis facility 30 makes its accept/reject de- 
cision are, in fact, the correct parameters to pro- 
duce a proper machine determination of UofW 
quality when operating in the automatic mode. By 
the operator adjusting these parameters, image 
quality analysis facility 30 "learns" to operate prop- 
erly. 

When image quality analysis facility 30 is set 
to the automatic mode, and when image quality 
analysis facility 30 determines that a UofW can be 
archived, then hierarchical index/data consolidation 
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facility 33 and hierarchical storage access facility 
34 operate to store the UofW on storage devices 
27. 

When image quality analysis facility 30 is set 
s to the verify mode, or when image quality analysis 
facility 30 indicates rejection of a document or a 
UofW, then suspect image review facility 31 allows 
an operator to visually review the document images 
of a UofW. The operator can elect to replace any 
10 suspect image by, for example, manual rescan of 
the suspect images, whereupon the operator can 
make an archive decision. 

The operator makes an archive/reject decision 
based upon a dynamic visual review of some, or 
is all, of the suspect images in the UofW, and can 
also use a related report for that UofW, which 
report is generated by image quality reporting fa- 
cility 32. 

If the UofW is accepted by the operator at 
20 suspect image review facility 31, the archive pro- 
cess (i.e., storage of the UofW at storage devices 
27) proceeds, either by way of automatic operation, 
or archiving is manually invoked by the operator at 
suspect image review facility 31. If the UofW is not 
25 accepted by the operator at suspect image review 
facility 31, then no archive takes place, and the 
entire UofW must be recaptured by operation of 
image scanner 37, or perhaps by operation of a 
low speed recapture scanner (not shown). A reject 
30 decision causes the UofW to be deleted from 
DASD 39. 

As part of the work flow of FIG. 4, image 
quality reporting facility 32 operates automatically, 
or on operator demand, to provide hard copy print- 

35 out detailing and summarizing information, either 
for an individual UofW or for an entire time period 
of operation of image quality analysis facility 30. 
Thus, image quality reporting facility 32 enables 
the evaluation and compilation of both long and 

40 short term trends and statistics relative to suspect 
image occurrences, and suspect image processing 
by image quality analysis facility 30. This evalu- 
ation and compilation is controlled by operator 
specified parameters. 

45 Suspect image review facility 31 allows human 

operators to browse through document images of 
either accepted documents or suspect documents. 
This image browse function allows operators, at 
suspect image review workstations 31, to examine 

so all of, or perhaps just some of, the images that are 
contained in an operator-specified UofW. This 
browse function includes features, such as zoom, 
enhance, show alternate views, print, etc. Note that 
this image browse function takes place while the 

55 UofW still resides only on DASD 39; i.e., the UofW 
has not as yet been archived. While the operator 
can specify any Document Identifier (Dl) of a docu- 
ment image to be reviewed, generally it is desir- 

6 
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able that the images be reviewed in descending 
order of suspiciousness value. The operator need 
not know the Dl of a document whose images are 
to be reviewed, but can alternatively specify a DDS 
whose images are to be reviewed. More specifi- 
cally, the operator can specify review of a DDS by 
using its identifier, or can specify that the next DDS 
be presented for review. 

FIG. 6 illustrates how image quality analysis 
facility 30 selectively operates in an automatic 
mode, or a human intervention mode, at the elec- 
tion of an operator. Capture system 24 provides an 
output to image quality analysis facility 30, as 
above described. When image quality analysis fa- 
cility 30 has been set to the automatic mode, and 
when image quality analysis facility 30 accepts a 
UofW for archive, then hierarchical index/data con- 
solidation facility 33 and hierarchical storage ac- 
cess facility 34 operate to automatically store the 
UofW at storage devices 27 without the need for 
human intervention. 

When image quality analysis facility 30 has 
been set to the verify or human intervention mode, 
then suspect image review facility 31 is given the 
opportunity to review both accepted and rejected 
UofWs. The operator, at suspect image review fa- 
cility 31, can elect to accept a UofW without re- 
view, whereupon hierarchical index/data consolida- 
tion facility 33 and hierarchical storage access fa- 
cility 34 operate to store the UofW at storage 
devices 27. If the operator, at suspect image re- 
view facility 31 elects to browse some or all of the 
document images of a UofW, then the operator can 
elect to accept the UofW after review, or the oper- 
ator can replace bad document images by using a 
manual, slow speed scanner to rescan the rejected 
documents of the UofW, or the operator can reject 
the UofW after review and perhaps then initiate a 
rescan of all rejected documents of the UofW. 

Relative to FIG. 5, as each UofW (typically 
comprising from ten thousand to one hundred thou- 
sand documents or checks) becomes available for 
archive, hierarchical index/data consolidation facility 
33 processes a UofW by consolidating or pack- 
aging individual DDSs into larger DDS groups or 
objects (each containing 100 DDSs, for example) 
prior to storing the consolidated data on storage 
devices 27 by operation of hierarchical storage 
access facility 34. 

Each such DDS group includes an index that is 
constructed by hierarchical index/data consolidation 
facility 33. This index specifies the storage location 
or address of individual DDSs within the DDS 
group. In addition, hierarchical index/data consoli- 
dation facility 33 generates an identifying key for 
each such DDS group. 

FIG. 5 shows a hierarchical index in accor- 
dance with the invention, this index defining the 



sequential method of storing DDS group files. 

The hierarchical indexing and data consolida- 
tion function shown in FIG. 5 (i.e., 33 of FIG. 3) 
operates to consolidate individual DDS elements 
s into larger data structures, two of which are iden- 
tified as DDS group N and DDS group M. As 
shown, DDS group N comprises DDS N1 ( DDS N2, 
etc., whereas DDS group M comprises DDS M1, 
DDS M2, etc. 

io Each such DDS group is indexed as a single 

entity (for example, by a pointer 45 for DDS group 
N), which pointer 45 includes the media volume ID 
47 and the index location 48 in this media volume 
where DDS group N and its index 49 are stored. 

75 In addition, each index that is stored for each 

DDS group (for example, index 49 for DDS group 
N) contains a pointer for each individual DDS within 
the DDS group (for example, pointer 50 to DDS 
N1). 

so In addition, each stored DDS may include an 

index to the sub elements of the DDS. For exam- 
ple, as shown in FIG. 5, DDS N5 includes a pointer 
to the storage locations 51 that contain the various 
image views of DDS N5, the coded data for DDS 

25 N5, and other associated data, such as voice data 
for DDS N5. 

As an alternative to what is shown as document 
level index 52 in FIG. 5, each DDS subelement 
may be self- identified as to its length and type, 

30 thereby allowing a simple data parsing scheme to 
locate the subelements of a DDS. 

Library level index 60 of FIG. 5 contains a set 
of pointers or records identified as 45,46 — , each 
record pointing to a specific DDS group. Depend- 

35 ing upon the storage size of the archive device and 
the storage size of each media volume, there may 
be one library level index 60 per media volume, or 
the library level index may be maintained on a 
separate, high speed access media, such as 

40 DASD, or perhaps even in memory. 

As will be appreciated, the hierarchical scheme 
of FIG. 5 can be extended to an arbitrary number 
of levels, providing increased levels of index con- 
solidation. 

45 Hierarchical index/data consolidation facility 33 

of FIG. 3 requests hierarchical storage access fa- 
cility 34 to store a DDS group, such as group N at 
devices 27. Hierarchical index/data consolidation 
facility 33 creates a record of all such DDS groups 

so that have been successfully archived at devices 27, 
thus allowing the deletion of the specified DDS 
groups from the CIMS portion of image database 
facility 36, thereby freeing up storage space that is 
associated with the CIMS portion of image 

55 database facility 36. 

The number of DDSs to be consolidated into a 
single DDS group can be defined by the operator, 
and can be changed to suit the storage characteris- 
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tics of storage devices 27. 

All DDS groups that are formed by hierarchical 
index/data consolidation facility 33 may include a 
document level index, such as 52 of FIG. 5. that 
contains the addresses of the associated image 5 
data, coded data, and other data related to each 
DDS within the DDS group. When a DDS group is 
later retrieved, this index 52 allows direct access to 
data within an DDS group with a granularity that 
depends upon the granularity of the DDS group's to 
index 52. 

Hierarchical storage access facility 34 can re- 
trieve a partial DDS group by first retrieving the 
DDS group's index 52, from which the address of 
the required item is identified, and the specific is 
DDS item is then retrieved from storage 27. 

When hierarchical index/data consolidation fa- 
cility 33 operates in a retrieval mode, hierarchical 
index/data consolidation facility 33 first determines 
which DDS group contains the requested item. For 20 
example, a request for the coded data contained 
within DDS N1 is known to be contained in DDS 
group N. The index 49 of DDS group N is now 
retrieved from storage, the address of DDS N1's 
coded data is read, and this address is used to 25 
fetch this coded data from storage 27. 

In order to retrieve all DDSs that are contained 
in DDS group N from archive storage, the retrieve 
request from hierarchical index/data consolidation 
facility 33 need contain only the address of the first 30 
DDS within DDS group N. This retrieve request 
results in the fetching of all DDS group N DDSs 
from storage 27. 

When a specific DDS is requested, or when a 
portion of an DDS is requested (for example, the 35 
DDS N5). specifying this DDS's identifier results in 
the fetching of index 49 of DDS group N from 
archival storage. Index 49 is then used to find the 
address of DDS N5, or its related data, within DDS 
group N. 40 

FIG. 7 illustrates operation of the invention 
wherein operation begins with the scanning of a 
check at 100, This scanning of a check results in 
the formation of a plurality of digital images at 101, 
the formation of digital records of the check's cod- 45 
ed data and associated data at 102, and the detec- 
tion of anomalous conditions during check scan- 
ning and handling at 105. At 103, the images 
provided by 101 and the data provided by 102 are 
consolidated, or formed into DDSs, a document 50 
level index is formed for this DDS, and this DDS is 
temporarily stored. 

At 104, an operator has defined a plurality of 
digital image quality parameters by which digital 
images 101 are to be machine judged. 55 

At 106, the machine uses image quality param- 
eters 104, detected anomalous conditions 105, and 
digital images 101 to compute suspiciousness val- 



ues. As a result of this comparison, a tentative 
accept/reject decision is made at 110. The details 
of construction and operation of function 106 is 
described in detail in patent application Serial 
Number 08/195,728, entitled "Image Quality Analy- 
sis Method and Apparatus", filed February 14, 
1994, incorporated herein by reference. 

When the decision at 110 is to accept for 
archive, a plurality of DDSs are assembled into a 
DDS group at 111, the group level index of FIG. 5 
is formed to locate, or address, each DDS within 
the DDS group, and archive storage of the DDS 
group and its group level index takes place at 113. 
Temporary storage 103 is now erased at 121. The 
library level index of FIG. 5 is formed at 122 to 
locate, or address, each DDS group in archive 
storage 27, whereupon the library levei index is 
stored in archival storage 27 or on DASD at 123. 

FIG. 7 illustrates an optional embodiment of the 
invention whereby selective human visual review of 
suspicious images occurs at 140. This review may 
result in selective rescanning of documents to form 
a new DDS at 141, with the possibility that subse- 
quent human override of tentative accept/reject de- 
cision 110 may occur at 142. FIG. 7 also illustrates 
that the operator may selective change digital im- 
age quality parameters 104 when the operator does 
not agree at 144 with the machine determination of 
quality. Adjustment of the image quality parameters 
at 143 is intended to bring machine accept/reject 
decision 110 into correspondence with the human 
review that occurred at 140. 

While invention has been described while mak- 
ing reference to preferred embodiments thereof, it 
is to be recognized that those of skill in the art will 
readily visualize yet other embodiment that are 
within the spirit and scope of the invention. Thus, it 
is not intended that the above detailed description 
be taken as a limitation on the invention. 

Claims 

1. A document archival method for processing 
one or more digital images of each of a plural- 
ity of documents and digital data that is asso- 
ciated with said documents, comprising the 
steps of; 

scanning a document and forming one or more 
digital images and associated data that cor- 
respond to said document, 
detecting anomalous conditions that may occur 
during said scanning and/or during subsequent 
image processing, 

defining a plurality of image quality param- 
eters, and 

computing a suspiciousness value for each of 
said plurality of digital images as a function of 
said parameters and said detected anomalous 
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able that the images be reviewed in descending 
order of suspiciousness value. The operator need 
not know the Dl of a document whose images are 
to be reviewed, but can alternatively specify a DDS 
whose images are to be reviewed. More specifi- 
cally, the operator can specify review of a DDS by 
using its identifier, or can specify that the next DDS 
be presented for review. 

FIG. 6 illustrates how image quality analysis 
facility 30 selectively operates in an automatic 
mode, or a human intervention mode, at the elec- 
tion of an operator. Capture system 24 provides an 
output to image quality analysis facility 30, as 
above described. When image quality analysis fa- 
cility 30 has been set to the automatic mode, and 
when image quality analysis facility 30 accepts a 
UofW for archive, then hierarchical index/data con- 
solidation facility 33 and hierarchical storage ac- 
cess facility 34 operate to automatically store the 
UofW at storage devices 27 without the need for 
human intervention. 

When image quality analysis facility 30 has 
been set to the verify or human intervention mode, 
then suspect image review facility 31 is given the 
opportunity to review both accepted and rejected 
UofWs. The operator, at suspect image review fa- 
cility 31, can elect to accept a UofW without re- 
view, whereupon hierarchical index/data consolida- 
tion facility 33 and hierarchical storage access fa- 
cility 34 operate to store the UofW at storage 
devices 27. If the operator, at suspect image re- 
view facility 31 elects to browse some or all of the 
document images of a UofW, then the operator can 
elect to accept the UofW after review, or the oper- 
ator can replace bad document images by using a 
manual, slow speed scanner to rescan the rejected 
documents of the UofW, or the operator can reject 
the UofW after review and perhaps then initiate a 
rescan of all rejected documents of the UofW. 

Relative to FIG. 5, as each UofW (typically 
comprising from ten thousand to one hundred thou- 
sand documents or checks) becomes available for 
archive, hierarchical index/data consolidation facility 
33 processes a UofW by consolidating or pack- 
aging individual DDSs into larger DDS groups or 
objects (each containing 100 DDSs, for example) 
prior to storing the consolidated data on storage 
devices 27 by operation of hierarchical storage 
access facility 34. 

Each such DDS group includes an index that is 
constructed by hierarchical index/data consolidation 
facility 33. This index specifies the storage location 
or address of individual DDSs within the DDS 
group. In addition, hierarchical index/data consoli- 
dation facility 33 generates an identifying key for 
each such DDS group. 

FIG. 5 shows a hierarchical index in accor- 
dance with the invention, this index defining the 



sequential method of storing DDS group files. 

The hierarchical indexing and data consolida- 
tion function shown in FIG. 5 (i.e., 33 of FIG. 3) 
operates to consolidate individual DDS elements 
s into larger data structures, two of which are iden- 
tified as DDS group N and DDS group M. As 
shown, DDS group N comprises DDS N1, DDS N2, 
etc., whereas DDS group M comprises DDS M1, 
DDS M2. etc. 

10 Each such DDS group is indexed as a single 

entity (for example, by a pointer 45 for DDS group 
N), which pointer 45 includes the media volume ID 
47 and the index location 48 in this media volume 
where DDS group N and its index 49 are stored. 

75 In addition, each index that is stored for each 

DDS group (for example, index 49 for DDS group 
N) contains a pointer for each individual DDS within 
the DDS group (for example, pointer 50 to DDS 
N1). 

20 In addition, each stored DDS may include an 

index to the sub elements of the DDS. For exam- 
ple, as shown in FIG. 5, DDS N5 includes a pointer 
to the storage locations 51 that contain the various 
image views of DDS N5. the coded data for DDS 
25 N5, and other associated data, such as voice data 
for DDS N5. 

As an alternative to what is shown as document 
level index 52 in FIG. 5, each DDS subelement 
may be self- identified as to its length and type, 
30 thereby allowing a simple data parsing scheme to 
locate the subelements of a DDS. 

Library level index 60 of FIG. 5 contains a set 
of pointers or records identified as 45,46 — , each 
record pointing to a specific DDS group. Depend- 
as ing upon the storage size of the archive device and 
the storage size of each media volume, there may 
be one library level index 60 per media volume, or 
the library level index may be maintained on a 
separate, high speed access media, such as 
40 DASD, or perhaps even in memory. 

As will be appreciated, the hierarchical scheme 
of FIG. 5 can be extended to an arbitrary number 
of levels, providing increased levels of index con- 
solidation. 

45 Hierarchical index/data consolidation facility 33 

of FIG. 3 requests hierarchical storage access fa- 
cility 34 to store a DDS group, such as group N at 
devices 27. Hierarchical index/data consolidation 
facility 33 creates a record of all such DDS groups 

60 that have been successfully archived at devices 27, 
thus allowing the deletion of the specified DDS 
groups from the CI MS portion of image database 
facility 36, thereby freeing up storage space that is 
associated with the CIMS portion of image 

55 database facility 36. 

The number of DDSs to be consolidated into a 
single DDS group can be defined by the operator, 
and can be changed to suit the storage characteris- 
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tics of storage devices 27, 

All DDS groups that are formed by hierarchical 
index/data consolidation facility 33 may include a 
document level index, such as 52 of FIG. 5, that 
contains the addresses of the associated image 
data, coded data, and other data related to each 
DDS within the DDS group. When a DDS group is 
later retrieved, this index 52 allows direct access to 
data within an DDS group with a granularity that 
depends upon the granularity of the DDS group's 
index 52. 

Hierarchical storage access facility 34 can re- 
trieve a partial DDS group by first retrieving the 
DDS group's index 52, from which the address of 
the required item is identified, and the specific 
DDS item is then retrieved from storage 27. 

When hierarchical index/data consolidation fa* 
cility 33 operates in a retrieval mode, hierarchical 
index/data consolidation facility 33 first determines 
which DDS group contains the requested item. For 
example, a request for the coded data contained 
within DDS N1 is known to be contained in DDS 
group N. The index 49 of DDS group N is now 
retrieved from storage, the address of DDS NVs 
coded data is read, and this address is used to 
fetch this coded data from storage 27. 

In order to retrieve all DDSs that are contained 
in DDS group N from archive storage, the retrieve 
request from hierarchical index/data consolidation 
facility 33 need contain only the address of the first 
DDS within DDS group N. This retrieve request 
results in the fetching of all DDS group N DDSs 
from storage 27. 

When a specific DDS is requested, or when a 
portion of an DDS is requested (for example, the 
DDS N5), specifying this DDS's identifier results in 
the fetching of index 49 of DDS group N from 
archival storage. Index 49 is then used to find the 
address of DDS N5. or its related data, within DDS 
group N. 

FIG. 7 illustrates operation of the invention 
wherein operation begins with the scanning of a 
check at 100. This scanning of a check results in 
the formation of a plurality of digital images at 101, 
the formation of digital records of the check's cod- 
ed data and associated data at 102, and the detec- 
tion of anomalous conditions during check scan- 
ning and handling at 105. At 103, the images 
provided by 101 and the data provided by 102 are 
consolidated, or formed into DDSs, a document 
level index is formed for this DDS, and this DDS is 
temporarily stored. 

At 104, an operator has defined a plurality of 
digital image quality parameters by which digital 
images 101 are to be machine judged. 

At 106, the machine uses image quality param- 
eters 104, detected anomalous conditions 105, and 
digital images 101 to compute suspiciousness val- 



BNSDOCID: <EP 0671696A1_I_> 



ues. As a result of this comparison, a tentative 
accept/reject decision is made at 110. The details 
of construction and operation of function 106 is 
described in detail in patent application Serial 

5 Number 08/195.728, entitled "Image Quality Analy- 
sis Method and Apparatus", filed February 14, 
1994, incorporated herein by reference. 

When the decision at 110 is to accept for 
archive, a plurality of DDSs are assembled into a 

io DDS group at 111, the group level index of FIG. 5 
is formed to locate, or address, each DDS within 
the DDS group, and archive storage of the DDS 
group and its group level index takes place at 113. 
Temporary storage 103 is now erased at 121. The 

75 library level index of FIG. 5 is formed at 122 to 
locate, or address, each DDS group in archive 
storage 27, whereupon the library level index is 
stored in archival storage 27 or on DASD at 123. 
FIG. 7 illustrates an optional embodiment of the 

20 invention whereby selective human visual review of 
suspicious images occurs at 140. This review may 
result in selective rescanning of documents to form 
a new DDS at 141, with the possibility that subse- 
quent human override of tentative accept/reject de- 

25 cision 110 may occur at 142. FIG. 7 also illustrates 
that the operator may selective change digital im- 
age quality parameters 104 when the operator does 
not agree at 144 with the machine determination of 
quality. Adjustment of the image quality parameters 

30 at 143 is intended to bring machine accept/reject 
decision 110 into correspondence with the human 
review that occurred at 140. 

While invention has been described while mak- 
ing reference to preferred embodiments thereof, it 

35 is to be recognized that those of skill in the art will 
readily visualize yet other embodiment that are 
within the spirit and scope of the invention. Thus, it 
is not intended that the above detailed description 
be taken as a limitation on the invention. 

40 

Claims 

1. A document archival method for processing 
one or more digital images of each of a plural- 
45 ity of documents and digital data that is asso- 

ciated with said documents, comprising the 
steps of; 

scanning a document and forming one or more 
digital images and associated data that cor- 
50 respond to said document, 

detecting anomalous conditions that may occur 
during said scanning and/or during subsequent 
image processing, 

defining a plurality of image quality param- 
55 eters, and 

computing a suspiciousness value for each of 
said plurality of digital images as a function of 
said parameters and said detected anomalous 
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conditions. 

2. The method of claim 1 including the steps of; 
making a recommendation to archive based 
upon the suspiciousness values of said one or 
more digital images, and 

archive storing said one or more digital images 
and said associated data in a digital storage 
device only when an accept decision to ar- 
chive has been made. 

3. The method of claim 2 including the step of; 
providing temporary storage of digital images 
and associated data prior to said accept/reject 
decision step, and 

erasing said temporary storage after said ar- 
chival storing step. 

4. The method of claim 2 including the step of; 
assembling a plurality images and associated 
data of accepted documents into a data group 
for archival storage, said data group containing 
an index identifying the storage location within 
said data group of each of the accepted docu- 
ments assembled thereinto, and 

said step of archive storage including the step 
of identifying the storage location of each data 
group stored in said digital storage device. 

5. The method of claim 4 including the step of; 
retrieving a selected document from said digi- 
tal storage device by defining the storage loca- 
tion of the data group containing said selected 
document, 

fetching said data group index from said digital 
storage device at said defined data group stor- 
age location, 

reading the storage location of said selected 
document from said fetched index, and 
fetching said selected document from said 
digital storage device. 

6. The method of claim 2 including the step of; 
providing human visual review of the digital 
images of documents having one or more digi- 
tal images that are of suspect quality, and 
making a document accept/reject decision 
based upon said visual review. 

7. The method of claim 6 including the step of; 
when said document accept/reject decision is 
to reject, providing a rescan function. 

8. The method of claim 2 including the step of; 
converting sard digital images to visual images, 
providing visual review of said visual images 
by a human operator, and 

changing said digital image quality parameters 



in a manner to produce correspondence be- 
tween said operator visual review and said 
accept/reject decision step. 

5 9. A document image processing method, com- 
prising the steps of; 

machine scanning a document and forming a 
plurality of digital images that correspond to 
said document, 
to detecting anomalous conditions that may occur 

relating to said machine scanning, 
defining a plurality of digital image quality pa- 
rameters, 

machine calculating an image suspiciousness 
75 value for each of said plurality of digital images 

based upon said parameters and said detected 
anomalous conditions. 

machine calculating a document suspicious- 
ness value based upon said parameters and 
20 said calculated image suspiciousness values, 

and 

using a machine to make a document ac- 
cept/reject decision based upon said document 
suspiciousness value. 

25 

10. The method of claim 9 including the step of; 
machine storing said plurality of digital images 
only when an accept decision has been made. 

30 11. The method of claim 10 including the step of; 

when a reject decision has been made, provid- 
ing rescan of said rejected subject matter. 

12. The method of claim 10 including the step of; 
35 using a machine to assemble a plurality of 

digital images from a plurality of accepted doc- 
uments into a data group for storage in a 
digital storage device, 

said data group containing an index defining 
4<? the storage location within said data group of 

said plurality of digital images, and 
said storing step including the step of identify- 
ing the storage location of each data group 
that is stored in said digital storage device. 

46 

13, The method of claim 12 including the step of; 
using a machine to retrieve at least one digital 
image of a selected document from said digital 
storage device by defining the storage location 

so of the data group containing said selected doc- 

ument, 

using a machine to fetch said index of said 
data group from said digital storage device, 
using a machine to read the storage location of 
55 said selected document from said fetched in- 

dex, and 

using said read storage location to machine 
fetch said at least one digital image of said 
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selected document from said digital storage 
device. 



said operator visual review and said machine 
accept/reject decision step. 



14. The method of claim 10 including the steps of; 
machine scanning a large plurality of docu- 5 
ments to form for each of said documents at 
least one digital image, 

forming a similar large plurality of associated 
data individually corresponding to each one of 
said large plurality of scanned documents, w 
using a machine to assemble the plurality of 
digital images and the corresponding data that 
correspond to a small plurality of documents 
into a data group, 

providing a library level index pointing to the ts 
storage location of said data group, 
providing a group level index pointing to the 
storage location of said digital images and 
corresponding data in said data group, and 
archive storing said library level index, said 20 
group level index, said digital images, and said 
corresponding data of said data group. 

15. The method of claim 14 including the step of; 

for each document in said data group, provid- 25 
ing a document level index pointing to the 
storage locations of said digital images and 
associated data that correspond to each said 
document, and 

storing said document level index. 30 

16. The method of claim 10 including the step of; 
using a machine to convert at least one digital 
image of a document into a visual image, 
providing visual operator review of said visual 35 
image, and 

making an operator accept/reject decision of 
said document based upon said visual review. 

17. The method of claim 16 including the step of; 40 
using a machine to store digital images of a 
document for which an accept decision is 
made. 

18. The method of claim 9 including the step of; 45 
providing temporary digital storage of docu- 
ment images prior to said accept/reject de- 
cision step, and 

using a machine to erase said temporary stor- 
age after said machine storing step. 50 

19. The method of claim 9 including the step of; 
using a machine to convert digital images to 
visual images, 

providing review of said visual images by a 55 
human operator, and 

changing said digital image quality parameters 
so as to produce correspondence between 
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